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ABSTRACT 



This document introduces simulation as a field of endeavor 
that has great potential for education research, development, and training. 
Simulation allows education developers to explore, develop, and test new 
educational programs and practices before communities, educators, and 
students are asked to participate in them. Simulation technologies exist in 
at least four major forms: (1) gaming, formalized play with rules players 

follow; (2) role-playing, in which participants assume specific parts in 
defined situations; (3) simulators, systems in which operators and machines 
interact in ways that approximate real life; and (4) modeling, 
experimentation with representations of a system. Some uses of these 
approaches in education research are given. These applications include a 
change game, in which change in a school district is presented as a game and 
a role-playing simulation in program planning at WestEd. Another example is a 
task simulation at the Far West Consortium for Educational Development, 
Dissemination, and Evaluation. Simulation and its modern-day companion, 
virtual reality, will play a major role in entertainment and science for the 
foreseeable future. These new applications will be useful in education 
research through constructing artificial prototypes, studying living systems, 
and imitating how the brain works. Three appendixes provide two examples of 
simulation in use in education research settings and a list of modeling 
software vendors. Contains a 32-item annotated bibliography. (Contains 1 
figure and 23 references.) (SLD) 
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Preface 

This publication introduces the scope of 
simulation as a field of endeavor. We believe 
that simulation holds great potential as a tool for 
education research, development, and training. 

The far-reaching and idiosyncratic problems of 
education at the turn of this century demand 
new research and development tools with which 
to create innovative solutions. Although simula- 
tion has been widely used by the military and in 
business to explore and test new ideas, so far, 
little use has been made of simulation in educa- 
tion. Yet, the advantages of using simulation are 
clear. It allows education developers to explore, 
develop, and test new educational programs and 
practices before communities, educators, and 
students are asked to participate in them. It 
allows us to provide training to teachers and 
other education professionals in a manner that is 
more in-depth and true-to-life than traditional 
training can ever be. Most important, simulation 
is a tool that helps education developers confront 
the perplexing reality of school reform. 

The Council for Educational Development and 
Research (CEDaR) publishes the EdTalk series to 



promote dialogue about important topics in 
education. We believe the potential of simula- 
tion as a development strategy is one such topic. 

This particular publication is a collaboration 
between the Council and WestEd, one of its 
member institutions, where Dr. Paul Hood has 
explored some of the uses of simulation in 
education R&D. The Council’s membership 
consists of some of the foremost education 
research and development organizations in the 
country. Many of these institutions incorporate 
the best educational research findings into 
school programs and practices. No group of 
institutions is more familiar with the history of 
education R&D, and its triumphs and disap- 
pointments. It has become clear to them that 
traditional research tools are inadequate and that 
there is an urgent need for designing and testing 
new techniques of development itself By 
publishing this overview of simulation, we hope 
to provide R&D organizations and others with a 
base of information with which to begin 
exploring the use of this exciting and potentially 
powerful tool for applying research knowledge in 
education. 
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challenged teams to develop a comprehensive “prospectus” for The results of the simulation became the foundation for CRDaRs 

addressing just one Bid problem, of their own selection, in educa- recommendations to the OERI Priorities Board on education 

tion ova a lO-ycar period. The goal would be achieving a solution research priorities. 

10 the lM(i educarional content problem with improved R&D 
[production and utilization processes and R&D inlrastructures. 



c 

mmmm 

E 



a. ^ 






OJ (U 

J-s ^ 



u 



JES _Q 
‘o 



■s 

c 

• ^ 

s 

•M 

C^ 

•M 

C/D 



<U 

s 
s 

o 
u 

(U 



5 

(U 

jC 



:3 

c 

u 

o 



-2 -a 
Oh3 

1 S 
. 2 
:§ a 

s s 

CO ^ 
^ - 1-1 
C^ ^ 

1-H ct 
C! O 

.5 -Q 

C <1^ 
W)^ 

(U 

-Q H 



c« 

u 

w 

CO 

C 

Ui 

a> 

nd 

o 



Uh 

O 

a> 

* -H 
Ui 

rt 

> 

<u 

"Td 



c 



•1 

c 

o 

+S 

o 

IS 

*TS 



u< 

(U 

(U 

C M 

(U > 

<u > 

o 






W) 

_Q 

s ■ 

_c 

CO 



^ -s 

•M -S 

- c 

(U O 

£ "Td 
p o 

:3 



C/D 

oj 



ct 

C 

• -H 

s 

O 

"O 

2 



cn 



Cd 

u 


Hi S 


• -H 

Ui 

cd 


1 

JJ 


2 


c c 


Ui 

U 


3 

Ui 


G 

O 

• »H 


^ § 
c ? 


lo 

Ui 

Cd 


"3 

G 

cd 


UI . 

cd 


•=I 0 




to 



_a 

.2 8 
3 U 
W) 

.S ba 

^ i 

^ JS Oh O 

cx,» 

^ ■ s 



52 S 

a 2 

3 • -H 

oJ *-• 
W) CO 

- s 

.^2 3 



to 

S e 

^ rt 

JS 2 

CX. t)iD< 

jy 2 

5 ^ 

> W) 
^ C 

Ui 

o .5 






C« 






3 

O 



CO 

(U 






. 2 ^ 

^ 8 
S 3 




SP 
o S 

to ^ 

2 i 

3 3 

-D ^ 

CO C 

3 O 

a ^ 

•> 
C ct 

O _c 
u -C 

”2 s 

C :3 

Cd Q> 
CO 

3 2 
c y 
o 

3 2 

CO H 

f <u 5 
2 o 

S— I • -H 

CL,. S3 
l 2 



CO 

CL, 

3 

0 
u, 

(20 

(U U 

to o 

3 w 
cd cd 

(30^5 

5 

•3 , cd 
> , Lm 

1 -s 

•- -i 
8 i 

6 

U 3 

2 3 
o ^ 

CO W) 

1 1 
s p 

to ^ 



O CO 

3 ^ 

O 3 

a R.' 

cd Om 

s a 

c: ►ii 

<U 

CO o 

^ 8 
•S g- 

6 3 

c 

.2 

UI cd 
cd OD 

3 

g 8 

.13 u 

CO ^ 



u O 

(U 
(U 



CO 

<U 

* 5 b 

(U 



2 >- 
tJ PQ 

SP G 
£ o 
*c 

Ui Cd 
Cd ^ 

^ Dm 

§ 

Cd ^ 
Ui 

o 



u 

(U 
CL, a 

^ 3 
(U o 



Ui 

(U 

> 

(U 

o 

X 



to 

c 



cd 

<u 



<u 

Qm 



O 

u 



oc 



CX ^ 

QD -P 
:N in 



.« 'P 



«a = 






05 

cS ^ ^ 



3 

s 

in 



c 

c cu ^ 
*F tr cn 

£ "5 ^ 

05 05 

O ^ D_ 



r^- i 



o 

ERIC 



19th century, versions ol Kmgsf, el widely IjgOs, James Coleman and 

used m military tra ning across Europe. Mink- eolleagues ar Johns Hopkins University 
ture wargaming, still^opular evo ved out of the 

Kn.gsp,el tradition. Though boatd ^mes (e.g., ,„eial theoty and improve education practice, 

checkers) were commercially published in Qne of rhe Johns Hopkins games, Cheno, was 



used to reveal the logic of inner-city life to their decisions. The dynamic interaction 

minority youth. The developers’ intent was to between players creates a complex and unpre- 
use their games to define the underlying rules of dictable scenario that is difficult to replicate in a 

urban social reform; as a tool of school reform, single person game. Single person games can 
the games would provide an engaging, participa- introduce unpredictability through random 
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business operation. This enables them to stage 
the interplay of finance, personnel, R&D, 
marketing, manufacturing, quality control, 
distribution, customer services and other aspects 
of an enterprise, sometimes including competi- 
tive, economic, political, social, regulatory, and 
other aspects of the environment. The games are 
dynamic and permit gamers to see the immedi- 
ate consequences of their decisions (which — 
simulated in compressed time — may reveal 
consequences after days, months, or even years 
of simulated time). A particularly attractive 
feature is the fact that the games are not puni- 
tive. Mistakes, errors of judgment, or bad 
decisions do not result in actual loss. The games 
are intrinsically motivating and usually create 
high levels of participant involvement. 

Hinrichs (1976, 855) identifies some of the 
problems with business games: 

1. “They often do not encourage or allow 
normal approaches, but limit behavior to those 
programmed in the situation.” [Computer- 
mediated business games have significantly 
relaxed these earlier restrictions that were often 
imposed in manual versions to make play 
control more manageable.] 



2. “Trainees may become too involved in the 
game per se and neglect to critique the 
effectiveness of their behavior. 

3. “There is a tendency to ‘lock in to whatever 
strategy proves effective in order to win the 
game. 

4. “There may be some questions of the degree 
of realism of the gaming situation as well as the 
degree to which the game situation is related to 
the trainees’ at-home situation. 

5. “Participation in the game may be costly, 
particularly where extensive computer time is 
entailed.” [Today, computer costs are rarely a 
problem.] 
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Setting up this kind of role-playing exercise 
requires substantial knowledge of the situation 
being simulated. I lere, in contrast to the 
complex hu,T>an-machine “high-fidelity” 
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with methods that allow them to easily approximates interacting with the real machine 

synthesize new ideas with previously acquired system. By contrast, nearly all games and 

knowledge and skills. simulation models, even if having some “flight 

simulator” characteristics, are much more 

Given these characteristics of adult learners, it abstract and symbolic in their representation of 
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research can obviously be conducted at markedly developing and testing long-term global 
lower costs (and risks) while probing traffic enterprise strategies. These massively larger 

density limits under various environmental and simulations may be systematically run under a 
workload conditions and dealing with various variety of global economic, political, and social 
kinds of emergency conditions. scenarios. Thus, beyond educational uses. 
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Testing Service researchers demonstrated that the 
decisionmaking styles of experienced male and 
female principals were markedly different, and 
that these tests had value both for training and 
assessing school administrator performance. 

Assessment centers. In 1956, Douglas Bray, 
following the OSS model, established a 
managerial assessment center for the American 
Telephone & Telegraph Company. The center 
became well known in industrial psychology 
because Bray ( 1 964a) conducted long-term 
follow-up studies of AT&T hires. Subsequent 
uses of the assessment center approach included 
selection of first-level foremen and higher-level 
management in some of the Bell companies 
(Bray, 1964b). During the early 1960s Standard 
Oil of Ohio, IBM, Sears, General Electric, and 
J.C. Penny established similar assessment centers 
(Finkle, 1976). 

By the 1970s, over a thousand organizations 
employed the assessment center approach. 

The approach was characterized by: (1) fixed-size 
groups ofassessees (e.g., 12 persons); (2) mul- 
tiple methods of assessment (including objective 
tests, projective tests, situational exercises, 
in-basket problems, questionnaires, interviews, 
group problem discussions, and peer ratings); 
and (3) high face validity of its assessment 
instruments, an impressive body of validation 



studies, and wide adoption. Most assessment 
programs gave assessees in-depth feedback about 
the evaluation of their performance, which 
served to increase the favorable reaction to them 
(Finkle, 1976). Assessment centers were adapted 
and used extensively by the University Council 
for Educational Administration and the 
National Association of Secondary School 
Principals (Pantili, et al., 1991). 

Business simulation assessment. Obviously, 
many of the business simulations discussed 
above may used for assessment purposes similar 
to the situational reaction tests described 
immediately above. 

Job sample simulation tests. These tests rest on 
the premise that “the best predictor of future 
performance is past performance.” They are 
grounded in careful analysis of the critical 
performance requirements of job tasks and the 
construction of simulated work sample tasks 
that will elicit behavior relevant to those 
performance capabilities. An illustration of this 
approach is discussed below as part of the 
DD&E Assessment Simulation. 
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level of fidelity may actually produce a more simulation away from the stance that “as experts, 

“robust” model since it is less likely to be influ- we privileged modelers have seen more deeply 
enced by highly detailed system components and and we’ll tell you how it works,” to we should 
interactions that, in fact, may not be valid. “help the world by showing them the way.” 

Modeling is a tool that can give power to the 
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wind tunnel, or for hydrodynamic performance about data or relationships, using probability 
in a water tank). functions. In some cases, an analytic solution 

may be available, but in many cases, we must use 
Mathematical modeling may involve static Monte Carlo or other simulation modeling 

representations (e.g., spreadsheets, flow charting) methods. These experiments may require 
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Understanding of the system. By experimenting • Demonstrates the implications of using 

with a model, we can better understand a various intervention strategies; 

system’s operation, how its components interact, • Shows how short-term change strategies may 

how users interface, and the role of the system affect longer-term system dynamics; 

in its environment. • Permits one to perform many experiments at 
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write program code. Even relatively novice Process simulation tools are rooted in electrical 

experimenters can combine their knowledge of and industrial engineering disciplines and tar- 
the system directly with the computer software geted at processes that are well-defined and 

modeling package to obtain almost immediate understood, such as manufacturing, inventory 

results. and distribution systems. They help quantify 
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system are simple “feedback loops” or “causal 

Continuous process modeling. Continuous loops” such as those found in the home thermo- 
process modeling graphically reveals system stat. Since the early 1960s, the principles of 
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system constantly revises and rearranges its 
building blocks as it gains experience with its 
environment. Each system typically has many 
niches which are exploited by agents adapted to 
fill them. The result is a system characterized by 
perpetual novelty. Systems evolve toward opti- 
mum states which are dynamic rather than 
static. A complex adaptive system evolves 
through self-organization toward “the edge of 
chaos” where it maintains its identity while 
dynamically changing to remain at a far-from- 
equilibrium state, neither falling into a stable 
nonadaptive equilibrium nor into chaotic 
behavior. 

Neural computing. Operating on a similar 
principle, neural computing imitates the 
structure and operation of the human brain. 
Central to this approach is a device known as a 
neural network, which is made up of a very large 
number of simple processing units connected 
together into a complex net-like structure. While 
conventional computing requires someone to 
work out a step-by-step solution and then 
program the steps into a computer, a neural 
network can be “trained” to solve many kinds of 
problems. Thus, a neural network effectively 
programs itself Training a neural network 
involves presenting the network with a series of 
examples of a problem and the desired solution 
in each case. Given enough training material, the 



neural network is able to learn the underlying 
principles involved in the solution, which it can 
then use to tackle other similar problems. Al- 
though the original idea dates back to the 1940s, 
it was not until the 1980s that computer 
hardware and software techniques capable of 
implementing neural computers became 
generally available. Users of IBM PC com- 
patibles and workstations have a wide choice of 
software products. Apple Macintosh users have a 
more restricted choice, but still have access to 
some powerful tools (NeuroBook, 1996). 
Examples of applications in modeling, predic- 
tion, and control include identification of 
general linear and nonlinear processes; 
forecasting river levels, stock market prices, 
currency exchange rates; and controlling of 
time-delayed industrial processes. 
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APPENDIX! 

THE SCHOOL GUIDANCE COUNSELOR: 

A DISCRETE EVENT WORKFLOW SIMULATION 




Guidance Services model; Shows what happens when two processes are not independent. 
The telephone calls(from parents) process takes precedence overthe student guidance 
process, causing the student guidance process to shutdown whenevera call comesin. 
This results in fewer student being counseled. Results at the end of the day shown below. 

Process 1: Student Counseling Problems 




27 students counseled 
interruption rather 
32 without 

(5 students still waiting 
in the queue.) 



16 calls 



Calls Done 



Phone call 

time: variable, 8 to 20 
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This simple workflow model (executed in Extend) shows the results at the end of one day 
(480 minutes) of simulation. There are two parallel processes. In Process 1: Student Counseling 
Problems, a random generator assigns a student problem resolution time (a normal distribution with 
mean of 12 minutes and standard deviation of 2 minutes). The Stud. In block produces a “student” 
token once every 15 minutes with a processing time selected by the random generator. Students 
proceed to a Stud. Wait queue where they wait until the counselor is not busy. The next student in line 
then proceeds to the Resolve (counselor) block for counseling. When through, the student moves to 
the Stud. Done block (which provides a mnning count of the number of students processed). In 
Process 2: Phone Calls from Parents, the random generator assigns variable call processing times 
(50%, 8 minutes; 20%, 12 minutes; 20%, 17 minutes; and 10%, 20 minutes.) The calls come in once 
every half hour, and are similarly processed. However, in this work flow there is a Measure block that 
tags the call with a priority status that interrupts the counselor processing of students in Resolve block 
in Process 1, until a parent call is completed. 

The results shown at the end of the day for this simulation indicate that 16 parent calls were 
handled and 27 students were counseled. However, five students were still waiting in the queue at the 
end of the day. 

In this simple simulation all 16 parents’ calls (one every half hour) will be processed since they 
create priority interrupts for the counselor. However, repeated simulations demonstrate that different 
numbers of student are processed and different numbers of students are still waiting in the queue at the 
end of the day, and that an average of 25 students will be processed and 7 students will be left in the 
queue at the end of the day. Thus, the depicted simulation is a little better in terms of the number of 
students left waiting than the average for a large number of simulations. 

By separating the two processes (such as by assigning someone else to handle the parent 
telephone calls) the counselor would nearly always be able to process all 32 students (one every 15 
rriinutes). Simulation of this model is accomplished simply by removing the “phone call” line 
connection between the Resolve block in Process 1 and the Measure block in Process 2 (just click on 
the connecting line and hit the delete key), and then mnning the simulation again. 

One can manipulate this model in a number of ways, e.g., by changing the statistical properties 
of the two random generators to change the processing times for calls and for students, by modifying 
the token input times for calls and students, or by assigning different levels of interrupt priorities to 
parent calls. 



What cannot be shown in the figure is the ability of Extend to display in fast or slow animation 
the movement of the student tokens and call tokens as they move from one block to the next through 
the network, the changing counts for tokens in the Wait blocks and in the Done blocks, or the time 
elapsed and simulation step count displays. The tokens appear in the animation as green circles inside 
the small squares next to the lines connecting the processing blocks. The final count numbers are seen 
inside the Done blocks. In animation, these numbers are incremented with the arrival of each token. 
This School Guidance Counselor model is a direct adaptation of Extend’ s demonstration SUPPSERV 
(Support Services) model. 

Extend’ s model building blocks (such as ones depicted in The School Guidance Counselor 
simulation example are grouped into libraries according to function; i.e., blocks commonly used in 
discrete event models can be found in the Discrete Event library. You place these process specific 
blocks on your model worksheet by selecting them from the library menu (merely drag and drop). 
Then connect them with the mouse, set appropriate parameters in the dialog boxes, and the model is 
ready to run. 

Since each Extend block has a pre-defined functionality, you merely need to enter parameters 
into each block’s dialog box (which opens when you double click on the building block icon). For 
example, set the delay time, establish a maximum queue length, or select a distribution (exponential, 
normal, Poisson, triangular. Erlang, uniform, Weibull, constant, LogNormal, HyperExponential, etc.) 
just by typing in numbers or clicking buttons in the Dialog box. Dialog boxes also provide you with 
simulation information like utilization rate, number of items entering or leaving the block, queue 
length, etc. 

For custom effects, you can combine the function of several blocks into one through hierarchy 
(build either top-down or bottom-up) or by using an equation editor. Or, custom blocks can be built 
using Extend’s built-in scripting language and dialog editor. This multiple hierarchy feature means that 
you can build a model as large as you want since there are virtually no limits with Extend. For 
example, processes (such as the student counseling problems or the phone calls from parents in The 
School Guidance Counselor simulation) can be combined into one at the next higher level in a 
hierarchical model; these larger components can be connected together, and then combined again to 
create new modeling units for a third level, and so on for as many levels as may be needed. Since units 
at any level can be saved, users can create their own custom libraries of model components. 

You can track items in your model by assigning attributes (such as part type, color, or cost) 
which can be recalled at any point in your model, or set a priority to items. With Extend, you can 
import data files, cut and paste to spreadsheets, or create a “live link” and update an Excel spreadsheet 
as your model runs. 



Results of running your simulation are provided in numerous forms. You may use blocks 
from Extend’ s Plotter library to produce tables and plots of simulation results. You can choose from a 
variety of plots: bar, histogram, worm, strip, scatter, multiple run, and more. For in-depth analysis and 
presentation, you can develop custom reports of model data. Simulation results and important statistics 
can be “cloned” to a Notebook (Control Panel interface) and combined with your own text and 
graphics to provide a unique and accessible interface to your model. To investigate how a parameter 
change impacts the pattern of behavior for the entire model, you can use Extend’ s sensitivity analysis 
feature to sensitize specific parameters. Other Extend features include animation (both built-in and 
custom), interruptible processes, full connectivity with the outside world (spreadsheets, databases, I/O 
boards, etc.), plus interactive model execution. 
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APPENDIX 2. 

DYNAMICS OF TEAMS GIVEN AUXILIARY FEEDBACK: 
A SIMULATION OF AN EDUCATIONAL SYSTEM 



Paul Hood, WestEd 

In Research-Based Development in Education: Its History and Future, Larry Hutchins and I 
suggested three alternative views of the future role of R&D in education in a Post-Modern, 
Constructivist environment. 

One alternative took a revisionist perspective — more traditional forms of product, program, and 
system development are still needed. We should be creative and complex in our thinking about how ah 
R&D-based innovation is adapted to local conditions. Some of the New American Schools “break the 
mold” models seem to be following this approach. 

A second perspective called for systemic change support — a productive line of attack would be to 
complement comprehensive technical assistance efforts with the development of educational system 
components that could be systematically combined and configured to fit local conditions. While each 
school is unique there are enough similarities among types of schools that highly sophisticated sets of 
combinable components, much like construction toys (Ae metaphor is the Erector Set, Tinker Toys, or 
Lego), developed for a particular group or type of school could easily be adapted (in mix and match 
combinations) to other schools of a similar type. This approach combines the reliability and efficiency 
of development of tested and validated components with the ability to combine and adapt these 
components, perhaps adding additional components over time, to meet particular needs and resources 
of local school communities. 

A third perspective, suggested by the concept of authoring in computer programming, envisions the 
development of support tools that allow a school (or even an individual teacher) to develop unique 
designs for education, but ones not possible without external support provided through educational 
systems design tools. The question is not so much whether schools need and can profit from such 
external support. Rather, the question is whether the external support is controlling or empowering. 

We saw the possibility of creating sophisticated “authoring” systems (the metaphor is CAD — 
Computer Aided Design) that could support local systems design. We acknowledged that “authoring” 
approaches to local innovation, design and development that empowered, rather than controlled the 
user would be a complex undertaking, but a task that a new generation of development could 
undertake. Such a challenge would require a level of complexity that matches the complexity of the 
school — no mean task, but one that R&D would be capable of. One part of such an authoring system 
would be the ability to simulate educational system operations in order to evaluate design alternatives. 
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When we wrote about that “authoring system” alternative, we knew that there was already more than a 
five-decade history of systems simulation R&D. In the 1950s, I had patched together four different 
training simulators (a flight simulator, a radar bombing/navigation training simulator, an electronic 
countermeasures simulator, and a gunnery simulator) to create the first B-52 air crew coordination 
training laboratory for the Strategic Air Command. Shortly later. Jay Forrester at MIT began his social 
systems simulations (employing a simulation language, DYNAMO, operating on a large MIT 
mainframe computer. 

At the Far West Laboratory, we had carefully studied Forrester’s 1969 book on Urban Dynamics and 
his 1971 book on World Dynamics. Encouraged by those simulations, more than 15 years ago, we 
had invited a number of scholars to convene at the Far West Laboratory to make an assessment of the 
state-of-the-art in systems simulation and the prospects for developing useful simulations of 
educational systems. Among the presenters, was a professor from Boston University who, working 
with some of Forrester’s students, had developed a simple educational simulation, using the 
DYNAMO language and the MIT computer. Although his simulation was interesting, our panel 
concluded that we did not yet have sufficient understanding of educational systems to warrant an R&D 
effort to develop such models. 

Peter Senge’s 1990 book. The Fifth Discipline, served to bring Forrester’s work on dynamic social 
simulations before a much larger audience. A related development was the adaptation of the 
DYNAMO mainframe computer simulation language to an application that would operate on a 
personal computer. In the late 1980s, STELLA became available for use on the Macintosh. A couple 
of years later, ithink, a business simulation version of STELLA, was developed for PCs. STELLA 
and ithink are almost identical, and they are immensely easier to learn and use than DYNAMO. 

Having recently acquired a demonstration version of ithink, I began searching for a simulation model 
that would be both interesting and instructive in actually modeling an educational system. Most of the 
models I found were simulations of business, manufacturing, sales, or ecological systems. 

However, late last year Brent deMoville posted on the Internet a team dynamics model that was just 
what I was searching for. The model portrays the interaction of support, knowledge, understanding, 
motivation (team members’ desire for teams), maturity, and success. 

The attached graphs were produced using the team training dynamics simulator model developed by 
Brent deMoville (San Angelo, TX). 
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The systems dynamic model involves five interrelated difference equations. Symbolically these are 
depicted in the following diagram as involving valved changes in rates of flows into (or out of) five 
reservoirs, thus affecting the levels in those reservoirs, labeled in the diagram below as: Knowledge, 
Employee desire for teams. Team Maturity, Team Success, and Supervisor Support of Teams. The 
levels in those reservoirs generate signals for control circuits that connect through various converters 
(the circles) to valves that affect the flows for other reservoirs. 

deMoville’s model involves three manipulable variables: (a) level of supervisor supp ort, (b) initial 
level of team success , and (c) amount of team training offered , [see the three levers and their settings 
above any of the attached graphs], as well as the number of problems (created by a random generator) 
that may occur during the process of work. 

In addition, dcMoville set a measure he called team success (the sum total of the team’s ability to 
overcome problems). He also set up a state he called the desire factor (desire for teams). This state is 
increased or decreased by a flow cdled change in desire which in turn is the result of the team’s level 
of understanding of the team process (as a function the level of knowledge generated through the rate 
of training offered) combined with the level o f supervisor support and the level of problems 
encountered. The level of desire for teams (created by the change in desire flow) then influences the 
team’s growth rate which in turn determines the team’s maturity level. This team maturity level is 
combined with the problems encountered to determine the changes in team success . The level of team 
success (and the three-month trend line of the rate of the team’s success) directly influences, positively 
or negatively, the rate of change in supervisor support . (And the level of supervisor support , in turn, 
acts as a feedback to influence, positively or negatively, the rate of change in desire for teams.) 
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I set the simulation to run for an eight-year period (scaled in months). Note that the scales along the 
left hand side of the graphs (see following pages) correspond to the five variables graphed. Supervisor 
Support (1), and Team Success (3) have both been scaled and fixed so that their zero values are at the 
mid-point of the vertical axis of the graph and their minimum and maximum values are held constant 
for all simulations. (This is not true for the other three variables, so please note their particular values 
for each simulation.) 
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In the first graph, you see the “nominal” run with Supervisor Support set at zero. Training Offered at 
0.1, and Team Success at 5. (I have left Team Success at 5 for all the remaining simulation runs.) In 
this simulation. Understanding (5) does not reach its maximum value until the end of the simulation. 
However, the Maturity Factor (4) reaches its maximum early in the sixth year. Starting at plus 5, by 
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the end of the first year, Team Success (3) develops a negative value and remains negative until late in 
the eighth year. It is late in the fifth year before the Team Success curve even turns upward in 
direction. Supervisor Support (1), which was set initially at zero trends downward until late in the 
seventh year. Despite this lack of support and a dismal success record, the team’s motivation, see 
Desire Factor (2), maintains an upward curve throughout the simulation (but the scale range is only 
from -0.04 to 0.37. 
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In the second graph, you see the effect of raising Supervisor Support to its maximum value of 100, 
while Training Offered remains at 0.1. Since Training Offered is still set at 0.1, the curve for 
Understanding (5) is identical to that of the previous simulation. However, as might be expected with 
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maximum support, the other simulation results are dramatically different. The Maturity Factor (4) 
reaches its maximum early in the third year. After a mild downturn in the first and second year. Team 
Success (3) turns upward and continues to show improvement in performance throughout the 
remainder of the simulation. Supervisor Support, starting at 100, dips almost imperceptibly and then 
trends upward toward 200. 

For the next three simulations I set Supervisor Support at 50 (exactly halfway between the extremes of 
zero and 100 in the previous simulations), but increased Training Offered to 0.3. (And the initial level 
of Team Success remains at plus 5.) With these modest levels of training and support, we see in the 
next graph that both the Maturity Factor (4) and Understanding (5) reach maximum values at almost 
identical times toward the end of the third year. Team Success (3) initially trends downward until the 
middle of the third year and then trends upward, improving through the remainder of the simulation. 
While starting at plus 5 and indicating negative values (as low as minus 5) in the second and third 
years. Team Success ends the simulation at a value of 41, more than eight times its starting point. 

To summarize, with these modest but perhaps realistic levels of support and training, it took the team 
almost three years to master understanding of team work and reach full team maturity. Knowledge 
rose rapidly in the first year and then trended upward through the second and third year to achieve it 
maximum value late in the third year. The Maturity Factor took a sharp drop in the first year, and then 
rose precipitously throughout the second and third year until it too reached its maximum value. 
Although motivation (the desire factor) continued to climb, the objective measure of Team Success 
slipped slightly downward until the middle of the third year and actually assumed small negative 
values throughout almost all of the second and third year. However, from the tum-around in the third 
year, the team training effort continues to pay off throughout the remaining years. 
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Given this “base line” simulation graphed immediately above, I next modified the simulation slightly 
to introduce the effect of a powerful annual accountability report that either was NOT aligned or was 
aligned with the goals of the team. (Think of the report as a system-level report or perhaps a student 
testing report, not a team performance report, that might or might not be aligned with the aims of the 
team.) 

My “accountability report” modification simulates the effect of an annual report, published in the eighth month 
of each simulation year, that is added as an annual pulse to the team’s problem input. If aligned, it acts as a 
powerful problem reducer during the week the report is published. If NOT aligned, it substantially multiplies the 
particular level of the problem faced by the team during the week the report is published. The “report” pulse 
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directly influences the Desire Factor (2), and indirectly influences the Team Success (3), the Supervisor Support 
(1) and the Maturity Factor (4). However, it has no effect on Understanding (5). The next graph shows the 
effect of the annual accountability report if it is NOT aligned. 
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Given the powerful negative effect of the annual report in the NOT aligned graph, Supervisor Support 
(1) remains on a downward trend throughout the eight-year period, and Team Success (3) does not 
make a turn-around in its downward slope until late in the fourth year. Team Success goes into 
negative values immediately after publication of the first accountability report in the first year and 
remains negative throughout the remainder of the simulation. (The curve suggests that Team Success 
might finally cross the zero line into positive values sometime, off the chart, late in the tenth year.) 
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Supervisor support, although trending downward throughout the eight years, remains positive, 
although very close to a zero value by the end of the simulation. (Since Supervisor Support lags Team 
Success, the Supervisor Support curve might begin to trend upward in the tenth or eleventh year. By 
that time, who would care!) 

Next, in the simulation below, we display the effect if the accountability report is perfectly aligned with 
the team’s goals. 
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Given the powerful positive effect of the annual report in the above “aligned” graph, Team Success (3) 
and Supervisor Support (1) dip only slightly downward in the first two years and then both climb 
higher throughout the remaining six years. Neither measure is ever negative in value. 

Note these last three simulations use exactly identical starting values for aU system factors (levels and 
flow rate settings). Note that Supervisor Support of Teams remains set at 50, (initial) Team Success at 
5, and Training Offered at 0.3. 

The only difference between the last two simulations is in the Problems generator in just one sign (+) 
or (-) in the formula for the annual pulse generator that simulates the publication of the report in the 
eighth month of each year. 

In both simulations. Understanding (5) (of team work) reaches a maximum value late in the third year 
at identical times. However, the maximum value for the team Maturity Factor (4) is delayed by almost 
two years in the NOT aligned simulation when compared to the aligned simulation. 

These two simulations are undoubtedly extreme situations. In both, we have assumed that the 
accountability report would have a very powerful effect on the team and the supervisor. (Please note 
that the factors operating within this team training simulation have no effect on the input value of the 
“accountability report.” It acts as an exogenous input pulse [that is amplified by a random generator]. 
Note the differences in the magnitude of the “jolts” in the curves, which are particularly easy to see in 
the Desire Factor (2) curve.) Because the annual effects are cumulative, two very different sets of 
simulations are created. Although these last two simulations are extreme cases, I believe that they 
make a compelling case for the need for alignment between external performance indicators and team 
success. 

As a final note, excluding the changes I made in the formula for the Problems generator, simply 
changing the settings for the three controls seen directly above each graph in this simulation model 
enables the user to run as many as 23,331 different combinations of initial settings for this team 
training simulation. Moreover, since the Problems generator includes a random generator, repeated 
simulation runs at any particular combination of settings for the three controls will not produce exactly 
identical results (although the differences are usually very small). 

However, through systematic experimentation, one may quickly learn that changes in the Team 
Success variable act mainly to raise or lower the elevation of the Team Success curve but do little to 
change its shape. Changes in the settings of Training Offered act mainly to advance or retard the slope 
of the Understanding curve and the date at which it reaches its maximum value (if that date is 
contained within the duration of the length of the simulation). The really powerful “leverage point” in 
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this simulation is found in the setting of the Supervisor Support of Teams. Please examine the first 
two graphs again in which Support was first set at zero and then at 100 (percent). When I asked 
myself where else in this dynamic system might there be another high leverage point, I concluded that 
it would be in the Problem generator, so that is where I introduced my “accountability report” pulse 
generator. 

Paul Hood, 5/23/96 
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APPENDIX 3. 

LIST OF LOW-COST MODELING SOFTWARE VENDORS 



All of the following modeling tools employ a Windows click and place or drag and drop metaphor to place shapes, 
connect lines, and place text on a drawing page or surface. Shapes are placed on the diagram, representing process 
steps or functions, and lines connect the shapes to show relationships. (Prices quoted are those published in 1996. But 
please call the vendor before ordering.) 

Extend ($695), Extend+BPR ($990). 

Imagine That, Inc. 6830 Via Del Oro, Suite 230, San Jose, CA 95119. Phone: 408-365-0305. 

An object-oriented environment for dynamically modeling, analyzing, reengineering, and documenting business 
processes. (See Appendix 1 for an example model.) 

ithink [and STELLA] (Standard Version: Retail $599; University faculty $259; Pre-college faculty $219) 

(Research/ Analysts: Retail $1099; University faculty $479; Pre-college faculty $399). Prices do not include shipping 
(add $5 for one package by UPS ground shipping). 

High Performance Systems, Inc., 45 Lyme Rd., Suite 300, Hanover, NH 03755 Phone: 800-332-1202 for 
Information & Ordering. 

ithink and STELLA are among the most popular and widely used programs for educational applications of 
continuous process simulations. (See Appendix 2 for an example model.) 

Optima! 2.0 ($695) Optimal Express 2.0 ($345) 

AdvanEdge Technologies Inc., 10170 SW Hedges Court, Tualatin, OR 97062. Phone: 503-692-8162 
Optima! Express is a highly automated discrete process mapping tool. Users create process maps by defining 
functional groups as horizontal bands, then place the appropriate flow chart symbol into the functional group that 
performs the process steps and then connect the symbols with lines and add text to show the flow of the process. 
Advanced features include the ability to assign attributes or variables to build a process model. Besides many pre 
defined attributes, users can create their own. Includes the ability to define a statistical distribution and a build-in 
expression builder. Optima! is the high-end version of the Optima! family of products. Includes all the features of 
Optima! Express, as well as features specific to process simulation and analysis. A built-in simulation guide allows 
users to create scenarios and view the results of multiple simulations side by side. A trace view adds color-keyed 
process animation. An extensive reporting facility includes ability to produce attractive charts. 

Process Charter ($600) 

Scitor Corporation, 333 Middlefield Road, Menlo Park, CA 94025. Phone: 415-462-4200; 1-800-549-9876. 

This flow-diagramming tool is combined with analysis and simulation capabilities to provide a powerful discrete 
process modeling program. Once a process is defined with the flowcharting tools, resources are identified and 
assigned to the process steps. Then, a simulation can be run and the results can be presented in graphical and statistical 
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forms that can be incorporated in reports. Process charter uses a familiar spreadsheet metaphor for adding resources, 
viewing activities, assigning resources to activities, and generating reports. Extensive options and deep dialog boxes 
provide capabilities to create sophisticated simulation models, including in-depth cost and resource analyses for 
business applications. 

STELLA (see ithink listing above, pricing is identical) 

Vensim 

Vensim Standard ($495) Vensim DDS ($1,995) 

Vensim Professional ($1,1 95) Vensim Runtime ($495) 

Vensim Personal Learning Edition (PLE) is free for academic use. 

In support of education and basic research, Ventana provides educational discounts for other configurations. 

Ventana Systems, Inc., 149 Waverley Street, Belmont, MA 02178. Phone: 617-489-5249 

Vensim is an integrated simulation framework for conceptualizing, building, simulating, analyzing, optimizing, and 
deploying models of complex dynamic systems. It is available for PC and Macintosh. The standard version allows 
users to create, articulate and simulate models. The professional version adds advanced modeling capabilities and 
enables optimization of model performance. The DSS version increases model capacity and provides tools for 
building decision support systems and learning simulators. The PLE is free for academic use, and is designed for 
beginning systems dynamics models. In the PLE, all menus and dialogs have been simplified; most option settings 
have been removed; it has a fixed toolset; the number of model building tools has been reduced; and a limited number 
of functions are supported. 
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